Search for: All records

We are developing a system for long term Semi-Automated Rehabilitation At the Home (SARAH) that relies on low-cost and unobtrusive video-based sensing. We present a cyber-human methodology used by the SARAH system for automated assessment of upper extremity stroke rehabilitation at the home. We propose a hierarchical model for automatically segmenting stroke survivor's movements and generating training task performance assessment scores during rehabilitation. The hierarchical model fuses expert therapist knowledge-based approaches with data-driven techniques. The expert knowledge is more observable in the higher layers of the hierarchy (task and segment) and therefore more accessible to algorithms incorporating high level constraints relating to activity structure (i.e., type and order of segments per task). We utilize an HMM and a Decision Tree model to connect these high level priors to data driven analysis. The lower layers (RGB images and raw kinematics) need to be addressed primarily through data driven techniques. We use a transformer based architecture operating on low-level action features (tracking of individual body joints and objects) and a Multi-Stage Temporal Convolutional Network(MS-TCN) operating on raw RGB images. We develop a sequence combining these complimentary algorithms effectively, thus encoding the information from different layers of the movement hierarchy. Through this combination, we produce a robust segmentation and task assessment results on noisy, variable and limited data, which is characteristic of low cost video capture of rehabilitation at the home. Our proposed approach achieves 85% accuracy in per-frame labeling, 99% accuracy in segment classification and 93% accuracy in task completion assessment. Although the methodology proposed in this paper applies to upper extremity rehabilitation using the SARAH system, it can potentially be used, with minor alterations, to assist automation in many other movement rehabilitation contexts (i.e., lower extremity training for neurological accidents). 

Present day ideals of good parenting are socio-technical constructs formed at the intersection of medical best practices, cultural norms, and technical innovation. These ideals take shape in relation to the fundamental uncertainty that parents/mothers face, an uncertainty that comes from not knowing how to do what is best for one's children, families, and selves. The growing body of parent-focused smart devices and data-tracking platforms emerging from this intersection frame the responsible parent as one who evaluates, analyzes, and mitigates data-defined risks for their children and family. As these devices and platforms proliferate, whether from respected medical institutions or commercial interests, they place new demands on families and add an implicit emphasis on how humans (often mothers) can be augmented and improved by data-rich technology. This is expressed both in the actions they support (e.g., breastfeeding, monitoring food intake), as well as in the emotions they render marginal (e.g., rage, struggle, loss, and regret). In this article, we turn away from optimization and self-improvement narratives to attend to our own felt experiences as mothers and designers. Through an embodied practice of creating Design Memoirs, we speak directly to the HCI community from our position as both users and subjects of optimized parenting tools. Our goal in this work is to bring nuance to a domain that is often rendered in simplistic terms or frames mothers as figures who could endlessly do more for the sake of their families. Our Design Memoirs emphasize the conflicting and often negative emotions we experienced while navigating these tools and medical systems. They depict our feelings of being at once powerful and powerless, expressing rage and love simultaneously, and struggling between expressing pride and humility. The Design Memoirs serve us in advocating that designers should use caution when considering a problem/solution focus to the experiences of parents. We conclude by reflecting on how our shared practice of making memoirs, as well as other approaches within feminist and queer theory, suggest strategies that trouble these optimization and improvement narratives. Overall, we present a case for designing for mothers who feel like they are just making do or falling short, in order to provide relief from the anxiety of constantly seeking improvement. 

Design is commonly understood as a storytelling practice, yet we have few narratives with which to describe the felt experiences of struggle, pain, and difficulty, beyond treating them as subjects to resolve. This work uses the praxis of embodied design as a way to bring more complex narratives to the community for contemplation---to engage and entangle personal and difficult stories within a public context. We propose the term Design Memoirs for these first-person practices and reflections. Design Memoirs are subjective and corporeal in nature, and provide a direct and observable way to reckon with felt experiences through, and for, design. We demonstrate Design Memoirs by drawing on our own experiences as mothers, caregivers, and corporeal subjects. Following Barad, we propose a practice of diffractive reading to locate resonances between Design Memoirs which render difficult autobiographical material addressable, shareable, and open for new interpretations. We present this strategy as a method for arriving at deeper understandings of difficult experiences.